ec943246b30930a1014c0dc3641600fa46c9a37b
Baseline submission baseline

 

challenge
Punctuation prediction from conversational language
submitter
Michał
submitted
2022-09-12 14:15:26.169905 UTC
file basename
out

test-A / 63e37a9a9e299f28e4373e9733da5e9e276ad115
Metric Score
Weighted-F1 8.42
Hyphens-F1 100.00
Comma-F1 8.07
Ellipsis-F1 12.11
Fullstop-F1 9.46
QMark-F1 0.00
Colon-F1 100.00
Excl-F1 0.00

dev-0 / f9ca1d2dd736c4622642d82983c59e486f9472cf
Metric Score
Weighted-F1 68.79
Hyphens-F1 80.00
Comma-F1 66.01
Ellipsis-F1 21.24
Fullstop-F1 88.31
QMark-F1 47.37
Colon-F1 100.00
Excl-F1 0.00

worst items

note: the gold standard is taken from the challenge
# input expected output actual output test-A Weighted-F1
1 audio/cbiz_tc_557.wav 10599a11-3bff-4ab0-836d-f9ed7a7cd8aa Wie:119580-119670 pan:119700-119760 co:119790-119880 O O B-ELLIPSIS O O B-QMARK 0.00
2 audio/cbiz_tc_557.wav 10599a11-3bff-4ab0-836d-f9ed7a7cd8aa Proszę:231570-231720 pana:231780-231930 skąd:232050-232380 wezmę:232440-232740 te… O B-COMMA O O B-COMMA O B-QMARK O O O O O O B-FULLSTOP 0.00
3 audio/cbiz_tc_557.wav 10599a11-3bff-4ab0-836d-f9ed7a7cd8aa @interia.pl:302610-302610 B-FULLSTOP B-FULLSTOPO 0.00
4 audio/cbiz_tc_557.wav af63e562-a918-42cd-a6b7-3f7f7c0111fb Tak:52320-52410 więc:52440-52560 poproszę:52770-53460 O O B-ELLIPSIS B-COMMA O B-FULLSTOP 0.00
5 audio/cbiz_tc_557.wav af63e562-a918-42cd-a6b7-3f7f7c0111fb Mhm:128910-128970 B-QMARK B-FULLSTOP 0.00
6 audio/cbiz_tc_557.wav af63e562-a918-42cd-a6b7-3f7f7c0111fb Czy:196950-196980 ma:197040-197070 pan:197130-197220 jakieś:197280-197490 O O O B-ELLIPSIS O O O O 0.00
7 audio/cbiz_tc_557.wav af63e562-a918-42cd-a6b7-3f7f7c0111fb Mhm:202080-202110 B-QMARK B-FULLSTOP 0.00
8 audio/cbiz_tc_26.wav 597f8543-06b5-4d46-b85c-cd8f43df2264 No:19560-19590 B-XCL B-FULLSTOP 0.00
9 audio/cbiz_tc_26.wav 597f8543-06b5-4d46-b85c-cd8f43df2264 I:46200-46200 co:46320-46350 jeszcze:46380-46590 O O B-QMARK O O B-FULLSTOP 0.00
10 audio/cbiz_tc_26.wav 597f8543-06b5-4d46-b85c-cd8f43df2264 A:52020-52020 właśnie:52110-52290 to:52320-52410 mój:52470-52710 O O O B-FULLSTOP O O O O 0.00
11 audio/cbiz_tc_26.wav 597f8543-06b5-4d46-b85c-cd8f43df2264 Tak:62490-62880 No:62970-63000 ja:63150-63180 systematycznie:63270-63870 spłacam:6… B-XCL O O O O O O B-COMMA O O O O O O O O O B-ELLIPSIS B-FULLSTOP O O O O O O O O O O O O O O O O B-FULLSTOP 0.00
12 audio/cbiz_tc_26.wav 597f8543-06b5-4d46-b85c-cd8f43df2264 No:144030-144060 ja:145440-145470 O B-ELLIPSIS O B-FULLSTOP 0.00
13 audio/cbiz_tc_26.wav 597f8543-06b5-4d46-b85c-cd8f43df2264 O:164400-164400 Boże:164520-164820 O B-FULLSTOP O O 0.00
14 audio/cbiz_tc_26.wav 597f8543-06b5-4d46-b85c-cd8f43df2264 żebyście:168270-168600 państwo:168660-168900 znowu:168960-169170 włączyli:169260-1… O O O B-QMARK O O O O O B-COMMA O O O B-COMMA O B-ELLIPSIS O O O B-FULLSTOP O O O O O O O O O O O B-FULLSTOP 0.00
15 audio/cbiz_tc_26.wav 597f8543-06b5-4d46-b85c-cd8f43df2264 pensję:173730-174120 B-FULLSTOP O 0.00
16 audio/cbiz_tc_26.wav 597f8543-06b5-4d46-b85c-cd8f43df2264 A:182700-182700 możecie:182730-182940 już:182970-183060 państwo:183150-183390 włąc… O O O O O B-COMMA O O O O B-QMARK O O O O O O O O O O O 0.00
17 audio/cbiz_tc_26.wav 597f8543-06b5-4d46-b85c-cd8f43df2264 Czyli:196830-196950 co:197100-197130 ja:197220-197250 mam:197310-197370 zrobić:197… O O O O B-QMARK O O O O B-FULLSTOP 0.00
18 audio/cbiz_tc_26.wav 597f8543-06b5-4d46-b85c-cd8f43df2264 w:219930-219930 tej:219990-220080 ciemności:220110-220620 dopóki:220680-220950 nie… O O B-COMMA O O B-QMARK O O B-XCL O O O O O B-FULLSTOP O O B-FULLSTOP 0.00
19 audio/cbiz_tc_26.wav a6c94040-593e-4280-8cbf-fb8fb1360e44 To:19830-19860 dobrze:20700-20940 już:21060-21150 poproszę:21300-21720 O B-COMMA O B-ELLIPSIS O O O B-FULLSTOP 0.00
20 audio/cbiz_tc_26.wav a6c94040-593e-4280-8cbf-fb8fb1360e44 Ta:72960-73020 B-ELLIPSIS B-FULLSTOP 0.00
21 audio/cbiz_tc_26.wav a6c94040-593e-4280-8cbf-fb8fb1360e44 to:115170-115230 B-ELLIPSIS O 0.00
22 audio/cbiz_tc_26.wav a6c94040-593e-4280-8cbf-fb8fb1360e44 jest:117720-117870 z:118080-118080 dnia:118230-118440 dwudziestego:118860-119520 m… O O O O B-FULLSTOP O O O O O 0.00
23 audio/cbiz_tc_26.wav a6c94040-593e-4280-8cbf-fb8fb1360e44 Termin:122520-122820 płatności:122970-123660 minął:123810-124290 O O B-ELLIPSIS O O B-FULLSTOP 0.00
24 audio/cbiz_tc_26.wav a6c94040-593e-4280-8cbf-fb8fb1360e44 Wartość:155340-155640 samej:155670-155940 O B-ELLIPSIS O B-FULLSTOP 0.00
25 audio/cbiz_tc_26.wav a6c94040-593e-4280-8cbf-fb8fb1360e44 No:203430-203490 B-ELLIPSIS B-FULLSTOP 0.00
26 audio/cbiz_tc_41.wav 3896bb9d-e80e-458e-9695-4f7427c1abdf Siedem:41910-42120 siedem:42180-42510 B-COMMA B-COMMA O B-FULLSTOP 0.00
27 audio/cbiz_tc_41.wav 3896bb9d-e80e-458e-9695-4f7427c1abdf jeden:43110-43290 B-FULLSTOP O 0.00
28 audio/cbiz_tc_41.wav 3896bb9d-e80e-458e-9695-4f7427c1abdf więc:112830-112980 się:113070-113130 zastanawiam:113190-113730 po:113790-113880 pr… O O O O B-COMMA O O B-FULLSTOP O O O O O O O O 0.00
29 audio/cbiz_tc_41.wav 1f0220c3-4246-4648-bbe4-53fcc8fe5318 i:130530-130530 wygeneruję:131610-131640 do:131730-131910 pani:132030-132270 ponow… O O O O O O B-COMMA O O O B-FULLSTOP O O O O O O O O O O O 0.00
30 audio/cbiz_tc_41.wav 1f0220c3-4246-4648-bbe4-53fcc8fe5318 ale:171750-171870 B-ELLIPSIS O 0.00
31 audio/cbiz_tc_24.wav e2a8a04f-2a58-4361-8d2b-c92bb50a7081 Dzień:12420-12570 dob:12690-12690 O B-ELLIPSIS O B-FULLSTOP 0.00
32 audio/cbiz_tc_24.wav e2a8a04f-2a58-4361-8d2b-c92bb50a7081 I:148740-148740 może:148800-148950 może:149040-149160 może:149430-149550 się:14961… O B-COMMA B-COMMA O O O O B-COMMA B-QMARK O O O O O O O O B-FULLSTOP 0.00
33 audio/cbiz_tc_24.wav c431c029-b346-4475-a95a-41139fdfac47 A:26580-26580 kiedy:26670-26850 składała:26910-27210 pani:27300-27420 reklamację:2… O O O O B-QMARK O O O O B-FULLSTOP 0.00
34 audio/cbiz_tc_24.wav c431c029-b346-4475-a95a-41139fdfac47 A:36150-36150 na:36450-36510 kogo:36600-36780 została:36870-37170 zawarta:37260-37… O O O O O B-QMARK O O O O O B-FULLSTOP 0.00
35 audio/cbiz_tc_24.wav c431c029-b346-4475-a95a-41139fdfac47 Ja:79980-80010 ja:80220-80250 już:80340-80430 ją:80520-80550 pani:80640-80760 prze… B-COMMA O O O O O O B-FULLSTOP O O O O O B-COMMA O O 0.00
36 audio/cbiz_tc_24.wav c431c029-b346-4475-a95a-41139fdfac47 wyjaśniamy:86850-87360 że:87450-87510 stany:87570-87780 licznika:87840-88170 na:88… B-COMMA O O O O O O O O O O O O O O O B-ELLIPSIS O O O O O O O O O O O O O O O O O 0.00
37 audio/cbiz_tc_24.wav c431c029-b346-4475-a95a-41139fdfac47 W:135690-135690 tym:135780-135840 momencie:135930-136290 O O B-ELLIPSIS O O B-FULLSTOP 0.00
38 audio/cbiz_tc_24.wav c431c029-b346-4475-a95a-41139fdfac47 od:141270-141330 tej:141450-141510 decyzji:141570-141900 na:141990-142020 adres:14… O O O O O B-ELLIPSIS O O O O O B-FULLSTOP 0.00
39 audio/cbiz_tc_56.wav 1b68cc28-468b-45e7-8d07-41101491b69e Domagala:151440-151440 B-COMMA B-FULLSTOP 0.00
40 audio/cbiz_tc_56.wav 1b68cc28-468b-45e7-8d07-41101491b69e tak:151530-151680 B-FULLSTOP O 0.00

Compare with other submission